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Abstract of EP1 255404 

A receiving terminal device which provides viewers with 
broadcasting radio waves from broadcasting stations as 
programs and In which, when a program switching is 
executed while a first program is being provided and a 
program is switched to a second program, the second 
program is provided and video recording of the first program 
is started, and when the program is switched back to the first 
program after the program Is switched to the second 
program, the recorded first program is provided. Then, the 
receiving terminal device, when the first program is selected 
again, executes catch-up reproduction of the recorded first 
program in the manner that the position of recording and 
reproducing the first program catch up with a position in ■ 
which the first program Is being broadcast by the 
broadcasting station. Thus, even In case that a switching of a 
program selection is executed, a broadcasting service 
without failure of program contents viewing can be realized. 
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RECEIVING TERMINAL DEVICE AND CONTROL METHOD THEREFOR 



Description of EP1 255404 



S Technical Field • 

[0001] This invention relates to output devices and receiving terminal devices for use in digital broadcasts. 



Background Art 



[0002] In general television broadcasting services, viewers receive broadcasting waves sent from broadcasting 
stations by receiving terminal devices and view programs which are expressed as audio/video information. 

[0003] That is, when a program is a real time type program, a receiving terminal device decodes and reproduces 
real time a selected stream from those transmitted from a broadcasting station thereby providing video/audio 
information to a viewer. When a viewer switches the channel, the receiving terminal device decodes and reprodui 
a newly selected stream instead of the stream being decoded and reproduced previously. 

[0004] In the case where the real time type program is viewed in the manner as described above, a viewer canno 
view a part of a program content during the program being viewed is interrupted and switched to another progranr 
view another program even when the channel is switched back to view again the program originally viewed. 
Therefore, when the viewer wishes to view a certain program consecutively, the viewer deals, with this by video 
recording the program and viewing it afterwards. 

[0005] However, it is very troublesome to operate for video recording every time of switching the channel and aft€ 
all; the viewer has no other way but records the program from the beginning. Further, in case that the pi-ogram m 
recorded from the beginning, it is difficult for the viewer to determine the time point to play, so that the viewer has 
search the point to resume by conducting high speed play reproduction. 

[0006] Further, implementation of digital broadcasting services multichannel broadcast and various services will t 
provided. For example, a service in which a broadcasting station controls receiving terminal devices of the viewer 
switch a program by using a transmission stream becomes possible. In this case, when it is controlled to switch X\ 
real time program to another program and then to switch back to the former program, viewing of the program is 
obstructed if a failure of the program content to view is cased, thus it is not satisfactory as a broadcasting service 

[0007] Consequently, it is an object of the present invention to provide a broadcasting service which does not cat 
failure of viewing of program contents even if the program selection is switched. 

[0008] ParticUferly it is an object of the present invention to provide a broadcasting service in which, when a real t 
program which is being viewed by a viewer is interrupted to switch to another program and then switched back to 
former program, the program is resumed from the program content at which the program is interrupted. 

[0009] Further, it is an object of the present invention to provide a broadcasting service in which, when a real time 
program which is being viewed by a viewer is interrupted to switch to another program and then switched back to 
former progranfi, viewing is resumed from the program content at which the program is interrupted and the time 
difference caused therefrom is solved gradually, so that the viewer does not feel uncomfortable. 



Disclosure of the Invention 



[0010] An aspect of the invention is a receiving terminal device which provides broadcasting waves from 
broadcasting stations to viewers as programs, in which, when program switching is executed while a first progran 
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being provided to switch to a second program, the second program is provided and a video recording of the first 
program is started, and when the switched second program is switch back to the first program, the recorded first 
program is provided. Switching between programs may be made by control information which is transmitted from 
broadcasting station or by voluntary switching (selection of stations) by a viewer. 

[001 1] Then, when the first program is selected again, the invention executes catch-up reproduction in the mannc 
such that the position of reproducing the first program catches up with the position in which the first program is be 
broadcasted by a broadcasting station. 

[0012] Thus, it becomes possible that the viewer, even while a program is being switched, views afterward center 
of the program which is being broadcasted by the broadcasting station. Further, it becomes possible that the viev\ 
views contents of the program with a smaller time than the time during which another program was being switche 

[0013] Specifically, the invention is a receiving terminal device which selects a particular stream from the receivec 
streams and reproduces the selected stream as video/audio information, characterized in that, when a second 

stream is selected while a first stream is being filtered through, the device stores a stream in the first stream 
Ifollowing the time point at which the second stream is selected and reproduces the selected second stream. 

[0014] Here,, the receiving terminal device is characterized in that, when the second stream is selected and 
thereafter the first stream is selected again, the stored stream is reproduced. 

[0015] Further, the receiving terminal device is characterized in that it obtains reproduction start position informati 
from the received stream and reproduces the stored steam from the reproduction start position. Thus, the receivir 
terminal device becomes possible to reproduce the stored stream from an arbitrary position. 

[0016] Furthermore, the receiving terminal device is characterized in that it obtains time management information 
the selected time point and reproduces the stored stream from the position specified by the obtained time 
management information. 

[0017] On reproduction of the stored stream, the receiving terminal device is characterized in that the stored strec 
is reproduced in* the manner such that the reproduction position of the stored steam in a reproduction time axis 
catches up with the reproduction position of the first stream in a real time axis. Further, it is preferable that the 
receiving terminal device displays on a screen a time difference information between the reproduction position of 
Stored steam in the reproduction time axis and the reproduction position of the first stream in the real time axis, 

[001 8] In addition, in order for the receiving terniinal device to reproduce the stored stream in the manner such th 
the reproduction position of the stored stream in the reproduction time axis catches up with the reproduction posil 
of the first stream in the real time axis, the stored stream may be reproduced in fast play reproduction. Further, th 
receiving terminal device may execute thin-out processing on the stored stream. 

[0019] As for this thin-out processing, there is a method in which the thin-out processing is applied to a particular 
fi-ame data to be generated based upon the stored stream. Further, there is a method in which a partial stream 
corresponding to a predetermined program content in the stored stream is processed to be thinned out. 
Furthermore, a partial stream in the stored streams corresponding to a program content other than a program 
content whichiis selected in accordance with user information inputted in advance may be processed to be thinne 
out. Moreover, when the stored stream contains n partial streams corresponding to the predetermined program 
content, n-1 partial streams may be processed to be thinned out. 

[0020] In addition, the partial stream to which the thin-out processing was applied may be stored and read out 
according to need to be reproduced. 

[0021] Further, the receiving tenninal device is characterized by storing the first stream until the reproduction 
position of the stored stream in the reproduction time axis catches up with the reproduction position of the first 
stream in the real time axis. 

[0022] Furthermore, the receiving terminal device is characterized in that, when the first stream is selected again 
after the second stream is selected, the selected first stream is reproduced on a first window and the stored stear 
reproduced on a second window. 

[0023] Here, the receiving terminal device is characterized in that a partial stream corresponding to the first progr 
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content in the stored stream is reproduced on the second window. Further, the receiving terminal device is 
characterized in that a partial stream corresponding to the second program content in the stored stream Is 
reproduced in fast play reproduction on the first window. 

[0024] The program switching is executed by controlling the receiving terminal device by a control signal which is 
sent from a broadcasting station. Further, it may be executed by operation of the viewer which is given through ai 
input unit. Furthermore, it may be executed in accordance with schedule information which is set based upon 
program guide information (EPG). 

[0025] Moreover, the invention is a receiving terminal device characterized by comprising a receiving unit for 
receiving a transferred stream, a memory unit for storing the received stream, an accepting unit for receiving 
program selection infomnation for selecting a program to be provided to a viewer, an selecting unit for selecting a 
particular stream in the received streams based upon the program selection information, an output unit for output 
video/audio Information based upon the stream to be transmitted, and a control unit for controlling in the manner 
such that the program selection information for selecting the second stream is received while the first stream is b« 
filtered through, a stream in the first stream following the time point at which the second stream is selected is 
outputted to the memory unit. 

[0026] Further, the invention is a method for providing a program characterized by comprising a step for switchinc 
a second program while a first program is being provided, a step for video recording of the first program while the 
switched second program is being provided, a step for switching back to the first prograhi while the switched sec( 
program is being provided, and a stage for proving the first program which is being recorded. 

[0027] The method for providing a program is characterized in that, when the first program is switched back, catcl 
up reproduction of the recorded first program and is executed in the mariner such that the position of recording ar 
reproducing the first program catches up with the position in which the first program is being broadcasted by a 
broadcasting station. 

[0028] iSpecifically, the invention is a control method of a receiving terminal device which selects a particular stre^ 
in the received streams and reproduces the selected stream as video/audio information, characterized in that, wh 
a second stream is selected while a first stream is being filtered through, a stream in the first stream following the 
time point at which the second stream is selected and the selected second stream is reproduced. Then, the contr 
method of the receiving terminal device is characterized in that, when the first stream is selected again after the 
second stream is selected, the stored stream is reproduced. 

[0029] The invention can be practiced as a program which realizes a predetermined function in collaboration with 
hardware such as a computer, etc., or a recording medium recording the program. 

[0030] In the present specification, means does not simply mean physical means but also includes a case in whic 
function that the means has is realized by software. Further, a function that one means has may be realized by t>A 
pr more physical means, and functions of two or more means may be realized by one physical means. 



Brief Description of the Drawings 



[0031] Fig. 1 is a block diagram showing a structure of a broadcasting station side transmission system according 
a first embodiment. 

[0032] Fig. 2 is a block diagram showing a structure of a receiving terminal device according to the first embodimi 



[0033] Fig. 3 is a block diagram showing a structure of a stream controlling unit according to the first embodiment 

[0034] Fig. 4 is a schematic diagram for explaining relation of a real time axis and a reproduction time axis. 

[0035] Fig. 5 is a flow chart for explaining an operation of the stream controlling unit according to the first 
embodiment. 

{0036] Fig. 6 is a flow chart for explaining an operation of the stream controlling unit according to the first 
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embodiment. 

[0037] Fig. 7 is a view for explaining one example of program switching w|ien a program is viewed as a stream. 
[0038] Fig. 8 is a view showing transition of a screen which is displayed on a display. 

[0039] Fig. 9 is a block diagram showing a structure of a stream controlling unit accordirig to a second embodime 

[0040] Fig. 10 is a block diagram showing a structure of a stream controlling unit according to a third embodiment 

[0041] Fig. 1 1 is a flow chart for explaining an operation of a catch-up reproduction processing unit according to tl 
third embodiment. 

[0042] Fig. 12 is a view for explaining one example of program switching. 

[0043] Fig. 1 3 is a view showing an example of a structure of a screen which is displayed on a display. 
[0044] Fig. 14 is a block diagram showing a structure of a stream controlling unit according to a fourth embodimei 
[0045] Fig. 15 is a block diagram showing a structure of a stream controlling unit according to a fifth embodiment. 
[0046] Fig. 16 is a view for explaining one example of program switching. 



Best Mode for Carrying Out the Invention 



[0047] Then, embodiments of the present invention will be explained with reference to the dravyings. 

[0048] in the invention, it is premised on mainly digital broadcasting services. In digital broadcasting services, vid< 
and/or audio information and data information can be multiplexed to be delivered to viewer. As a technology .for 
realizing such digital broadcasting services, MPEG2 standard is known. In the following embodiments, It will be 
explained with MPEG2 standard as an example. 



[First Embodiment] 



[0049] The present embodiment is characterized in that, in case that a receiving terminal device is controlled in . 
accordance with an instruction from a broadcasting station and after a real time program which is viewed by a vie 
is Interrupted once and switched to another program, it is returned to the former program., viewing is resumed frbr 
the program content at the time point of the Interruption. 

[0050] In addition, in the following explanation, it is assumed that the real time program is a program relating to 
normal television broadcasting and a program to be changed is a program relating to data broadcasting in the sai 
transport stream. Further, it is assumed that contents data of a program relating to data broadcasting is transferre 
by Carousel system. 

[0051] Fig. 1 is a block diagram showing a structure of a broadcasting station side transmission system according, 
the embodiment. A video/audio generating device 101 outputs video data (image data) and audio data (sound da 
which are sent out from a video camera and a video server which are not shown in the figure to a video/audio dat 
encoder (hereinafter, referred to as "video/audio data encoder") 103. In the specification, it is assumed that the vi 
data and the audio data are handled as one data as long as it does not stick to it particularly, and this is called as 
video/audio data. A data broadcasting generating device 1 02 outputs contents data for use in data broadcasting 
(hereinafter referred to as "data broadcasting data") to a data broadcasting data encoder 104. The data broadcas 
data comprises text data, image data (still picture/motion picture data), audio data, script (control program) and 
display object data and so on. In addition, the motion picture data has the same meaning as the video data but is 
used as such a meaning for distinguishing it from video data in television broadcasting. The data broadcasting da 
is produced by use of a not shown authoring terminal system based upon the video/audio data and other digital d 
and stored in a file server and so on. 
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[0052] A broadcasting management device 103 gives an instruction for sending the video/audio data and the daU 
broadcasting data to the video/audio generating device 101 and the data broadcasting generating device 102, in 
accordance with information relating to programming. The broadcasting management device 103 also sends out 
various information necessary for an operation for providing programs to a control information output device 107. 

[0053] The video/audio data encoder 104 compresses and encodes the video/audio data which is sent out from tl 
video/audio generating device 101 by control of the broadcasting management device 104 in accordance with 
MPEG2 video arid MPEG2 audio to generate a video/audio stream. The video/audio data encoder 104 sends out 
generated video/audio stream to a multiplexing device 108 in PES format. The data broadcasting data encoder 1i 
compresses and encodes the data broadcasting data which is sent out from the data broadcasting generating de' 
1 02 by the control of the broadcasting management device 1 03 to generate a data broadcasting stream. The daU 
broadcasting data encoder 105 sends out the generated data broadcasting data to the multiplexing device 108 in 
section format. 

[0054] An event message output unit 1 06 sends out an event message relating to the data broadcasting data whi 
is sent out from the data broadcasting generating device 102 to a control information output device 17. The event 
message is, as described later, data which is interpreted by a receiving terminal device of a viewer, and the 
receiving terminal device executes processing according to this event message. That is, taking a look from a 
broadcasting station side, the broadcasting station can control the receiving terminal device of viewer by using th« 
event message. The control information output device 107 generates various information which is sent out from tl 
broadcasting management device 103 and control information based upon the event message which is sent out f 
the event message output unit 106. The control information is defined as PSI/SI (Program Specific 
Information/Sen/ice Information). The control information output device 1 07 sends out the control information to a 
multiplexing device 108 in the section format. 

[0055] The multiplexing device 108 multiplexes the video/audio stream in the PES format and the data broadcast! 
stream and the control information in the section format to generate a MPEG2-transport stream (hereinafter refen 
to as "multiplexed stream"). The multiplexing device 108, on the occasion of generating the multiplexing stream, 
superposes furthermore time management information and so on according to need and executes a scramble 
concerning information to be kept as a secret. The multiplexing device 108 sends out the generated multiplexed 
stream to a digital modulating device 109. 

[0056] The digital modulating device 109 digitally modulates the multiplexed stream by a predetermined modulatii 
system and sends out this to a transmitting device 1 10. As the predetermined modulation system, for example, 
8PSK system, OFDM system and so on are exemplified. The transmitting device 110 transmits the digitally 
modulated stream as a broadcasting wave signal toward a relay station, for example, a broadcasting satellite. 

[0057] Fig. 2 is a block diagram showing a structure of the receiving terminal device according to the embodimen 
The receiving terminal device, typically, has a receiving function, a storing function, a communicating function an( 
presenting function. In the following, it will be explained about the receiving function and the storing function and t 
presenting function closely relating to the embodiment, out of these functions. In addition, such functions of the 
receiving terminal device can be realized by a hardware in mutual cooperation of a hardware and a software 
(program). 

[0058] A tuner 201 selects a broadcasting wave signal corresponding to a particular transponder in the broadcast 
wave signals which are supplied from a not-shown antenna and sends out it to a digital demodulating circuit 202. 

[0059] The digital demodulating circuit 202 demodulates the broadcasting wave signal which was selected and s( 
put by the tuner 201 , and after a predetermined error correction processing is executed, sends out it to a 
demultiplexer 203. The signal which is sent out from this digital demodulating circuit 202 corresponds to the abov 
described multiplexed stream. 

[0060] The demultiplexer 203 separates the multiplexed stream to be sent out and selects a particular video/audi( 
stream as the need arises and sends out it to a stream controlling unit 204. The demultiplexer 203, as to the 
separated data broadcasting stream, sends out it to a data broadcasting decoder 205b. The demultiplexer 203 
obtains PID (Packet Identifier) corresponding to a program to be selected and separates a stream in accordance 
with this PID. The demultiplexer 203 selects a video/audio stream, based upon a program selection operation of < 
viewer and program switching control by the event message. The demultiplexer 203, when it executes program 
switching processing, informs the stream controlling unit 206 of it. 
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[0061] An input unit 204 is an input device which is operated by a viewer and typically, corresponds to a rennqte 
controller and an operation panel which is formed in a main program of th,e receiving terminal device. When a vie* 
wishes to select a desired program and to execute an interactive operation to the program viewing the viewer, ca 
give an instruction to the receiving terminal device through the input unit 204. The program selecting information 
which is supplied from the input unit 204 is sent out to a program selecting unit 205. 

[0062] The program selecting unit 205 receives the program selecting information which is sent out from the inpul 
unit 204 and sends out an instruction to the demultiplexer 203 so that a program is selected in accordance with th 
program selecting information. The demultiplexer 203, when it receives the instruction from the program selectinc 
unit 205, selects a video/audio stream corresponding to a program to be selected. 

[0063] A stream controlling unit 206 controls an input/output path of the video/audio stream to be sent out to the 
decoder side. That is, the stream controlling unit 206 controls whether the video/audio stream which is sent out fp 
the demultiplexer 203 is sent out to a decoder 207 or to a storing device 208, and further, controls so as to send ( 
the video/audio stream which was stored in the storing device 208 to the decoder 207 instead of the video/audio 
stream which is sent out from the demultiplexer 203. 

[0064] The decoder 207 has a video/audio data decoder (hereinafter referred to as "VA decoder") 207a and a dal 
broadcasting decoder 205b. The same figure shows only one VA decoder 207a but a plurality of decoders may b' 
disposed. The VA decoder 207a decodes the video/audio stream to be sent in accordance with MPEG2 video an- 
MPEG2 audio. The VA decoder 207a sends out the decoded video/audio stream to an output controlling unit 210 
On the other hand, the data broadcasting decoder 207b decodes the data broadcasting stream and sends out 
contents data which is obtained by this decoding once to the storing device 208, and reads out the contents data 
from the storing device 208 in accordance with a predetermined presenting timing, and sends out it to a presenta 
engine 209. The data broadcasting decoder 207b also interprets an event message which is obtained by the 
decoding and executes processing based upon the event message. That is, the data broadcasting decoder 207b 
executes processing such as switching a program to be provided to a viewer, in accordance wjth the event mess; 
)Nhich is sent from a broadcasting station. 

[0065] The storing device 208 has a video/audio stream memory 208a for storing video/audio streams and a 
contents data memory 208b for storing contents data. The storing device 208, typically comprises a hard disk 
device, a RAM and so on, and it is preferable that it is of a built-in type one which is impossible. to be removed by 
user. In addition, in the same figure, one storing device 208 is configured by including the video/audio stream 
memory 208a and the contents data storing device 208b but may be configured by devices which are respectivel; 
independent physically. For example, the video/audio data storing device 208a may be configured by a hard disk 
device and the contents data storing device 208b may be configured by a flash memory device. Further, a cache 
function may be provided as the need arises. 

[0066] A presentation engine 210 generates a screen data for use as a data broadcasting screen (hereinafter 
referred to as "data broadcasting screen data") according to a predetermined display format, based upon content 
data which is sent out from the data broadcasting decoder 207b. A script which is contained in the contents data 
also interpreted and executed by the presentation engine 209 to be formed as the data broadcasting screen data 
The presentation engine 209 sends out the generated screen data to the output controlling unit 210. 

[0067] The output controlling unit 210 synthesizes the video/audio data to be sent and the data broadcasting sere 
data, and converts it into an output signal (an image signal and a sound signal) which is suited to an output devio 
and outputs it. In this figure, as the output device 21 1 , it is configured by a display (monitor) 211a and a speaker 
211b. 

[0068] Fig. 3 is a block diagram showing a functional structure of the stream controlling unit 206 according to the 
embodiment. As described above, a basic function of the stream controlling unit 206 is to select a input source ar 
destination of the video/audio stream to be sent to the decoder side: In the embodiment, furthermore, when readi 
put the stored video/audio stream and sending out it, the stream controlling unit 206 has another function to catcl- 
concerning the video/audio stream and execute reproduction processing. 

[0069] A program switching monitoring unit 301 monitors whether a program which is provided to viewers is switc 
or not, and in case that it is judged that a program was switched, controls a selector 302 according to a state of 
program switching. The selector 302 selectively switches destinations, based upon control of the program switchi 
monitoring unit 301 . The state of program switching is defined here as follows. 
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(1) Initial State: a state after which a particular program A is'selected but the program A was not selected in the p 
as after power was turned on. . , 

(2) First State: a state -after which is switched to a program B in the initial state. 

(3) Second State: a state after which is switched again to the program A in the first state. That is, it is a state aftei 
which the program A is switched to the program B and then returned again to the program A. This may also inclu* 
a case in which program B is switched first to a program C and then returned to the program A. 



[0070] The program switching monitoring unit 301 , in order to recognize which state is a state of program switchir 
when it receives a notice informing that a program was switched (selected), refers to an original program memory 
303 which stored program number of the program which was .being viewed until just before. That is, the program 
switching monitoring unit 301 , if a value which is stored in the original program memory 301 is null, determines th 
state of program switching was transferred from the initial state to the first state, and further, when program numt 
of the program A is already stored in the original program memory unit 301 and it receives a notice informing that 
program A was selected, determines that it was transferred from the first state to the secorid state. 

[0071] Thus, the program switching monitoring unit 301 , in case of the initial stage, gives an instruction to send oi 
the video/audio stream which is inputted from the demultiplexer 203 directly to the VA data decoder 207, and in c 
of the first state, gives an instruction to send out the video/audio stream directly to the storing device 208, and in 
case of the second state, gives an instruction to send out the video/audio stream through a real time reprpductior 
position obtaining unit 304 to the storing device 208. 

[0072] The original program memory unit 303 stores program number of a program which was viewed until just 
before as stated above. Further, when the program A is switched to the program B, and then to the program C ar 
thereafter returned to the program A, a program switching history may be stored. In this case, the program switch 
monitoring unit 301 may judge whether the program A exists in the history or not. 

[0073] The real time reproduction position obtaining unit 304 obtains a. position to be received and reproduced in 
real time axis of the video/audio stream which is received in real time and sent out through the demultiplexer 203. 
Meanwhile, the read-out reproduction position obtaining unit 305 obtains a position to be reproduced in a 
reproduction time axis of the video/audio stream to be read out from the storing device 208. 

[0074] More specifically, the real time reproduction position obtaining unit 304 obtains sequence number of a pac 
which configures the video/audio stream which is being received, and regards it as a reproduction position on a n 
time axis. Further, the read-out reproduction position obtaining unit 305 obtains sequence number of a packet wh 
configures the video/audio stream which is being read out from the storing device 208, and regards it as a 
reproduction position on a reproduction time axis. Here, in the context that receiving and reproducing are execute 
in synchronous with an actual transmission in a broadcasting station side, this is called as a reproduction in the n 
time axis, and in the context that reproducing is executed without synchronizing with the actual transmission of th 
broadcasting station side after the stream is one stored, this is called as reproduction in the reproduction time axi: 

[0075] Fig. 4 is a schematic diagram for explaining relation of the real time axis and the reproduction time axis. T\ 
same figure shows that in the real time axis, a stream of the program A and a stream of the program B are 
transferred from the broadcasting station side. Here, assuming that while the program A is being viewed, it was 
switched to the program B at a program switching time point El , and thereafter, at a program switching time poin' 
E2, the program B is switched again to the program A, the program content after the program switching time poin 
E1 is made to be viewed. Now, supposing that the program switching time point E2 is PI in the real time axis anc 
time passes over from PI to P2, the receiving terminal device is made to be reproducing a stream which is originj. 
at a position of P2. However, a reproduction position of the stream which is viewed in fact is P2' in the reproductic 
time axis. Difference of P2 in this real time axis and P2' in the reproduction time axis is called as a time difference 
Further, viewing in a state that this time difference occurs is called as a time difference viewing. Then, as describi 
later, the receiving terminal device in the embodiment reproduces the stored stream so as to solve the time 
difference of this P2 and P2'. That is, time difference D right after being returned to the program A is: 
D = P2 - P2' > 0 

but, by continuing the viewing of the program A, the stored stream is caught up and reproduced so that at a carta 
time point, it becomes: 
D = P2 - P2' = 0. 
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[0076] Returning to Fig, 3, a time difference detecting unit 306 obtains a time difference between a reproduction 
position of a video/audio stream in the real time axis and a reproduction position of a video/audio stream in the 
reproduction time axis, and informs a catch-up reproduction processing unit 307 of the time difference. The time 
difference detecting unit 306, at a time point that it judged that the time difference was solved, controls the selectt 
302 so as to directly send out the video/audio stream which is sent put from the demultiplexer 203 to the VA data 
decoder 207a. 

[0077] The catch-up reproduction processing unit 307 executes a catch-up reproduction processing to the 
video/audio stream to be read out, in such a manner that a reproduction position of the video/audio stream which 
read out from the storing device 208 catches up with a position in case that the video/audio stream which is sent • 
from a broadcasting station in the real time axis is reproduced. As for the catch-up reproduction processing, for 
example, a thin-out processing concerning the video/audio stream is exemplified. Even in case that the thin-out 
processing is executed, it is preferable that the processing is made so as not to give uncomfortable feeling to 
viewers. Therefore, in the. catch-up reproduction processing unit 307 in the embodiment, the catch-up reproductic 
executed in the manner that only video/audio stream corresponding to a main program content in the video/audio 
streams passes through and a program content (local event) other than the main program content, for example, c 
partial stream corresponding to a commercial program is revoked. Determination to a local event is executed with 
reference to a local event information table LIT (Local event Information Table) . Further, the catch-up reproductic 
processing unit 307 may detect commercial confirmation information and a predetermined description (descriptor 
revoke a partial stream (packets) corresponding to a commercial program. 

[0078] As for the catch-up reproduction processing, in addition to processing for thinning out a particular program 
content itself, so-called trick plays including a fast play reproduction, a frame drop reproduction and so on are 
exemplified. These are realized by thinning out sequentially I, P and B picture frames in the MPEG2 standard fror 
the B picture frame. 

[0079] It is preferable that such catch-up reproduction processing is executed during decoding the packet by the ^ 
data decoder 207a. In this case, the catch-up reproduction processing unit 307 is configured as a part of the VA c 
decoder 207a. If the VA data decoder 207a executes such catch-up reproduction processing, it is configured so a 
to perform trick play control, while the VA data decoder 207a is receiving the time difference information from the 
tirrie difference detecting unit 306. 

[0080] Further, as for the sound stream, it may be thinned out in a block unit, in order to synchronize video with 
audio. In this case, in the same way as normal reproduction of MPEG-TS, PGR (Program Clock Reference) may 
used, in order to synchronize video with audio. 

[0081] Fig. 5 is a flow chart for explaining an operation of the stream controlling unit 206 according to the 
embodiment. In this figure, the program switching monitoring unit 301 monitors whether a program is switched or 
not, that is, whether there is a notice informing that a program was changed from the demultiplexer 203 or the oul 
controlling unit 210 (STEP 501). The program switching monitoring unit 301 refers to the original program memor 
. 303 and judges whether a value of the original program memory 303 is null or not (STEP 502). That is, the progrg 
switching monitoring unit 301 judges whether a program switching state is in the initial state or not. When the 
program switching monitoring unit 301 judges that the value is null, it controls the selector 302 to send out a 
video/audio stream which is directly sent out from the demultiplexer 203 to the VA data decoder 207a(STEP 503) 
Thus, the selector 302 is made to select a terminal a in Fig. 3. The program switching monitoring unit 301 judges 
whether a program which was switched is a particular program or not (STEP 504), and in case that it is judged to 
the particular program, writes its program number in the original program memory 303 (STEP 505). The reason tf 
whether it is the particular program or not is judged is that the catch-up reproduction processing is executed as to 
the particular program. Accordingly, if the catch-up reproduction processing is executed as to all programs, the 
judgment processing of STEP 5604 may be omitted. 

[0082] On the other hand, at STEP 502, if the program switching monitoring unit 301 judges that the value of the 
original program memory unit is not null, it also judges whether the value is the program number of the particular 
program (STEP 506). If the program switching monitoring unit 301 judges that the value is the particular program 
number, it controls the selector 302 to send out a video/audio stream which is sent out from the demultiplexer 20; 
directly to the storing device 208. Thus, the selector 302 is made to select a terminal c set forth in Fig. 3. On the 
other hand, at STEP 506, if the program switching monitoring unit 301 judges that the value is the particular progi 
number, it controls to execute a storage/catch-up reproduction processing. That is, the program switching monito 
unit 301 controls the selector 302 to send out a video/audio stream which is directly sent out from the demultiplex 
203 to the VA data decoder 207a. Thus, the selector 302 is made to select a terminal b set forth in Fig. 3. At the 
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same time, the program switching monitoring unit controls to send out a video/audio stream which was read out fi . 
the storing device 208, instead of the video/audio stream which is sent out from the demultiplexer 203. to the VA 
data decoder 207a (STEP 508). , . " 

[0083] Fig. 6 is a flow chart for explaining the detail of the processing at STEP 508. As shown in this figure, the re 
time reproduction position obtaining unit 304 obtains a position to be reproduced in the real time axis by TOT (Tin 
Offset Table) or TDT (Time Data Table) from PSI of TS which passes through itself and informs the time diffierenc 
detecting unit 306 of it. On the other hand, the read-out reproduction position obtaining unit 305 obtains a * 
reproduction position in the reproduction time axis of a video/audio stream which passes through itself and infomr 
the time difference detecting unit 306 of it (STEP 601). 

[0084] A calculation of a time signal which is used in the time difference detecting unit 306 differs depending upor 
storing data format. In the time of storing, PSI is separated from TS and only MPEG-TS is stored, it is preferable 1 
use PGR as a substitute for TOS. Further, in case of a format for storing MPEG-PS, it is preferable to use ESCR 
a time signal. Further, it is possible to use a time signal based upon NPT (Normal Play Time). 

[0085] The time difference detecting unit 306 compares the informed reproduction position in the real time axis to 
reproduction position in the reproduction time axis and judges whether there is a time difference between them 
(STEP 602). If the time difference detecting unit 306 judges that there was the time difference, it gives an instruct 
for executing the catch-up reproduction processing to the catch-up reproduction processing unit 307, accordingly, 
the catch-up reproduction processing unit 307 executes (STEP 603). The catch-up reproduction processing unit, 
lona as it is judged that there is a time difference, executes the catch-up reproduction. On the other hand, a, time 
difference sensing unit 703, in case that it is judged that the time difference is solved, that is, the reproduction 
position in the reproduction time axis caught up with the reproduction position in the real time axis by the catch-uf 
reproduction processing, controls the selector 302 to send out a video/audio stream to the VA data decoder 207a 
(STEP 604). Then, the program switching monitoring unit 301 resets contents of the original program memory 30 
(STEP 605). In addition, in case that while the stream control unit 206 is executing the storage/catch-up reproduc 
processing, furthermore, that a program is switched is detected, for example, by an interruption processing, the 
stream control unit 206 stops storage/reproduction processing. 

[0086] Then, an operation example of the receiving terminal device which is configured as described above vyill b- 
explained with reference to Fig. 7 and Fig. 8. Fig. 7 is a view for explaining a condition of program switching wher 
program is viewed as a stream. In this figure, contents to be viewed by viewers are shown by a solid line arrow at 
contents to be viewed during the catch-up reproduction processing are shown by a wavy line arrow. Fig. 8 is a vie 
showing transition of a screen which is displayed on a display. 

[0087] Firstly, it is assumed that a viewer selects a real time program A of a broadcasting station which is conduc 
program providing services to which the storage/catch-up reproduction is possible. (A screen at this time is showi 
Fig. 8A(a). Hereinafter, same as above). It is assumed that a data broadcasting program B is one which realizes j 
interlock type data broadcasting service of the program A and transferred in advance by the Carousel system anc 
stored in the storing device 208. 

[0088] Now, it is assumed that while the main program content is being viewed, program switching El occurred a 
a screen was switched to the data broadcasting program B (the same figure (b)). The program switching El occu 
by, for example, fire by an event message which is transferred by a data broadcasting channel and a program 
switching operation by a viewer. The receiving terminal device starts a video recording of the program A which wi 
switched, that is, storage of its video/audio stream. Assuming that after lapse of predetermined time, program 
switching E2 occurred and the program A was selected again, the receiving terminal device starts reproduction ol 
the program A which was stored. In this time, the receiving terminal device, in order to solve the time difference 
which was occurred by the interruption, executes the catch-up reproduction processing concerning CM1 and CM2 
(the same figure (c)). The receiving terminal device displays the time difference on the screen, while the catch-up 
reproduction processing is executed, in order to present viewers how much time difference is occurring. The catc 
up reproduction processing is executed by for example, thin-out CM1 and CM2 themselves. Then, the receiving 
terminal device judges that even when CM1 and CM2 are thinned out, the time difference still can not be solved £ 
executes out the catch-up reproduction processing concerning a main content of the program A following CM2 (tl' 
same figure (d) ) . In this case, since it is not preferable to thin out itself in the same way as CM1 and GM2, the 
receiving terminal device executes fast play reproduction with the extent that a viewer can recognize the contents 
The extent (speed) of the fast play reproduction may be changed for example, by remote control of a viewer. The 
receiving terminal device, in case that it is judged that the time difference was solved (caught up) by the catch-up 
reproduction processing, returns the main content of the program A to nomial reproduction (the same figure (e)). 
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[0089] For example, it is assumed that time when the data broadcasting program B is presented for transition is 1 
minute and 15 seconds. Further, it is assumed that CM1 and CM2 are of 3p seconds, respectively. In this case, tl 
receiving terminal device thins out CM1 and CM2 so that the time difference of remaining 15 seconds is made to 
occur. Assuming that, as the catch-up reproduction processing to the main content, the 1 0 second reproduction ir 
the real time axis is executed for 8 seconds in the reproduction tihne axis (20% fast play reproduction), the catch-i 
is accomplished for 75 seconds. 

[0090] In the operation example, it was explained that commercial programs CM1 and CM2 were thinned out and 
catch-up reproduction processing is applied to a portion of the time difference which could not be appropriated by 
the fast play reproduction to the main content but the fast play reproduction may be applied to CM1 and CM2 anc 
only extent of start several seconds may be reproduced, respectively. Furthermore, the fast play reproduction ma 
not be applied to the main content but the catch-up reproduction processing may be applied only to the commerc 
programs. That is, to the main content, the catch-up reproduction (time difference reproduction) by nornial 
reproduction may be applied and every time that a commercial program is broadcast, the catch-up reproduction 
processing may be applied to the commercial program until the time difference is solved. 

[0091] As described above, according to the embodiment, when a particular program which is being viewed by a 
viewer is switched to another program, storage of the stream corresponding to the program is started and when tl 
switched program is switched to the former program] the stored stream is reproduced and contents of the prograr 
which was interrupted can be viewed without fail. ' 

[0092] Further, according to the embodiment, since the catch-up reproduction processing is executed on the 
occasion of reproducing the stream which was stored, the time difference in the real time axis can be solved. 

[0093] Accordingly, a viewer can view a real time program, without recognizing a video recording reservation, witi 
enjoying a program switching. 

[Second Embodiment] 

[0094] This embodiment relates to a modified example of the above-described storage/catch-up reproduction 
processing, and more specifically, is characterized in that a stream (packet) which is judged to be unnecessary 
because of the catch-up reproduction processing is not revoked but stored again in the storing device 208 so thai 
viewer can view it by reading out and reproducing it at arbitrary timing. 

[0095] Fig. 9 is a block diagram showing a structure of the stream controlling unit 206 according to the embodime 
In this figure, the same symbols are applied to the same element for realizing functions as In the above embodimi 

[0096] As shown in the figure, the stream controlling unit 206 further comprises a read-out controlling unit 901 am 
selector 902, and the catch-up reproduction processing unit 307' is configured so that it can send out again a 
video/audio stream which became an object for the catch-up reproduction processing to the storing device 208. Ir 
addition, it is preferable that the catch-up reproduction processing unit 307', on the occasion of storing again in th 
storihg device 208, stores with respect to each category which the program contents belong to. Such category ca 
be specified with reference to LIT. Further, filtering information in accordance with preference of a viewer may be 
in advance and program contents which are judged to be necessary may be stored in the storing device 208 in 
accordance with this filtering information. The filtering information is inputted through for example, the input unit 2 . 
and stored in a predetermined memory area. 

[0097] The read-out control part 901 , when it receives an instruction for video recording and reproducing through 
input unit 204 from a viewer, controls the selector 902 to directly send out a video/audio steam which is read out 
from the storing device 208 to the VA data decoder 207a. At this time, it is preferable that the receiving terminal 
device stops receiving by the tuner 201 . Thus, the receiving terminal device, in the same way as normal video 
recording and reproducing, can read out the stream which was stored again in the storing device 208 and can 
reproduce it. Accordingly, a viewer, for example in case of convenient time for him/her, can view only commercial 
programs. 
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[third Embodiment] 



[0098] This embodiment relates to a modified example of the above-described storage/catch-up reproduction 
processing, and more specifically, is characterized in that in a particular program, when a certain program conten 
broadcast for the second time or more, thin-out is executed to the second or subsequent broadcast program cont 
in the receiving terminal device. In other words, in case that a portion which is stored contains the same program 
content, reproduction is executed by avoiding overlap of the content. 

[0099] Fig. 10 is a block diagram showing a structure of the stream controlling unit 206 according to the 
embodiment. In this figure, the same symbols are applied to the same means for realizing functions as in the abo 
embodiment. 

[0100] As shown in the figure, the stream controlling unit 206 further comprises a reproduction program content 
memory 1001. The reproduction program content memory 1001 stores information for identifying a program conU 
corresponding to a stream which is an object for the catch-up reproduction processing and which has been alrea( 
sent out to the VA data decoder 207a. A catch-up reproduction processing unit 1002 refers to the reproduction 
program content memory 1001 and judges as the same program content as the program content which had been 
already reproduced, executes the catch-up reproduction processing concerning a video/audio stream which is be 
read out. 

[0101] Fig. 1 1 is a flow chart for explaining an operation of the catch-up reproduction processing unit 1002 accorc 
to the embodiment. As shown in this figure, the catch-up reproduction processing unit 1002, as to a video/audio 
stream which is being read out from the storing device 208, judges whether it is a program to be catch-up 
reproduced or not (STEP 1 101). In this embodiment, it is assumed that a particular program content such as a 
commercial program and so on is an object for the catch-up reproduction. If the catch-up reproduction processing 
unit 1 1 02 judges that the program content is the object for catch-up reproduction, judges whether it is no yet " , 
reproduced even once, that is, it is an initial reproduction or not (STEP1 102). The catch-up reproduction process! 
unit 1002 judges as the initial reproduction, writes identification information of its program content in the reproduc 
program content memory 1 001 (STEP 1 1 03), and directly sends out the video/audio stream to the VA data decoc 
207a (STEP1 104). On the other hand, when the catch-up reproduction processing unit 1002 judges that the prog 
content was already reproduced, that is, the program is reproduced for the second time or more, because the 
identification information is recorded in the reproduction program content memory 1001, the catch-up reproductio 
processing unit 1002 executes the catch-up reproduction processing on a video/audio stream that is read out 
(STEP1 105). In case that a program content is not the object for catch-up reproduction, for example is content of 
main program, the catch-up reproduction processing unit 1001 sends out the video/audio stream to the VA data 
decoder 207a. 

[0102] Next, an operation example of the receiving terminal device according to the embodiment will be explainec 
use of Fig. 12. Fig. 12 is a view for explaining a condition of program switching when a program is viewed as a 
stream. In this figure, a content which is viewed by a viewer is shown by a solid line arrow and a content which th 
catch-up reproduction processing is applied to is shown by a wavy line arrow. 

[0103] It is assumed that a viewer selects a real time program A of a broadcasting station which is conducting a 
program providing service which the storage/catch-up reproduction can be applied to. Further, it is assumed that 
program B is also a real time program. 

[0104] Now, it is assumed that while, the commercial program CM1 is being viewed following the main program 
content, the program switching E1 occurs and it is switched to the program B. The program switching El occurs I 
for example, a fire triggered by an event message which is transferred by a data broadcasting channel, or a progi 
switching operation conducted by a viewer. The receiving terminal device starts a video recording of the program 
which was switched, that is, storage of its video/audio stream. Assuming that after lapse of predetermined time, 
program switching E2 occurred and the program A was selected again, the receiving terminal device starts 
reproduction of the program A which was being stored. The receiving terminal device, since CM2 has not yet bee 
viewed, reproduces it as-is. and thereafter reproduces the main content and CM3. When the receiving terminal 
device comes to the point where the CM1 is just being reproduced, it thins out (skips) the CM1 because it judges 
that the CM1 was already viewed. Thus, it is possible to solve the time difference by a time portion which is requii 
for reproduction of CM1. The receiving terminal device, after it skips CM1 , reproduces the main program content, 
the embodiment, even by the thin-out of CM1 , the time difference which is generated by the interruption can not t 
solved. Then, it is preferable that the receiving terminal device, in case that CM2 and CMS are broadcast again, 
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solves the time difference by thinning out them. Further, a commercial program may be reproduced in fast play. 

[0105] As described above, according to the present embodiment, when a certain program content is broadcaste< 
for the second time or more in a particular program, the reproduction of that program content which is broadcaste 
for the second time or more will be omitted. Accordingly, the viewer will be forced to view the same commercial 
program, etc., repeatedly. 

k\ [Fourth Embodiment] 



[0106] This embodiment relates to a modified example of the above-described storage/catch-up reproduction 
processing. More particularly, this embodiment is characterized in that, a main program content in a particular 
program is displayed on a first window (screen) and another program content as an object for catch-up. reproduct 
is displayed on a second window. 

[0107] For example, as shown in Fig. 13(a), the receiving terminal device divides a screen area which is displaye- 
on a display 21 1a into a screen W1 and a screen W2, and reproduces a* program content on respective screens. 
Such a vievying mode is called as a multiscreen. In this figure (a), a program content of the main program is 
reproduced on the screen W1 and a commercial program in the stored program contents is reproduced on the 
screen W2. Further, as shown in this figure (a), the receiving terminal device may divide the screen are into 3 are 
In this case, it is preferable that an aspect ratio of the screen is converted from 16:9 to 4:3. 

[0108] Fig. 14 is a block diagram showing a structure of the stream controlling unit 206 according to the 
embodiment. In addition, in this figure, the same symbols are applied to the same means for realizing functions a 
the above embodiment. 

[0109] As shown in the figure, the stream controlling unit 206 sends out a video/audio stream corresponding to a 
main program content to be displayed on the first screen and a video/audio stream corresponding to another 
pj-ogram content to be displayed on the second screen to the VA data decoder 207a, respectively. That is, as to e 
main program content, the stream controlling unit 206 sends out a video/audio stream which was read out from t^ 
storing device 208 to the VA data decoder 207a in the same manner as in the above embodiment until the time 
difference is solved, and at the time point that the time difference is solved, sends out a video/audio stream which 
sent out from the demultiplexer 203 to the VA data decoder 207a. On the other hand, as to a content of another 
program sugh as a commercial program, etc., other than a main program, the stream controlling unit 206 sends o 
the video/audio stream which was read out from the storing device 208 separately to the VA data decoder 207a. 
More specifically, a catch-up reproduction processing unit 1401 judges that a video/audio stream which was read 
from the storing device 208 corresponds to a main program or not, and when it is judged as the video/audio strea 
corresponding to a program other than a main program, for example, a commercial program, sends out to the VA 
data decoder 207a separately from the video/audio stream corresponding to the main program content. Thus, sin 
the stream control part 206 is possible to send out a more video/audio stream from the storing device 208, the tin 
difference can be solved. 



[Fifth Embodjnoent] 

[01 1 0] This embodiment relates to a modified example of the above-described storage/catch-up reproduction 
processing. More specifically, the embodiment is characterized in that at a time point that a program is switched, 
position information (reproduction start position information) by which reproduction of a stream is to be resumed i: 
set and stored in advance, and when it is returned to the program, reproduction is resumed from the stream 
specified by the reproduction start position information. 

[01 1 1] Fig. 15 is a block diagram showing a structure of the stream control unit 206 according to the embodiment 
this figure, the same symbols are applied to the same means for realizing functions as. in the above embodiment. 

[01 12] In the embodiment, in order to simplify an explanation, it is assumed that a video/audio stream is all sent o 
through the storing device 208 to the VA data decoder 207a. That is, in the initial state, a video/audio stream is 
stored through the terminal c of the selector 302 in the storing device 208 and read out from the storing device 2C 
and sent out through the selector e to the VA decoder 207a. 
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[0113] When the program switching monitoring unit 301 judges that the initial state is transferred to the first state, 
program switching monitoring unit 301 stores program number of the program A and reproduction start position 
information into the original program memory 303. In the embodiment, it is assumed that an event ID of LIT whic^ 
defined as PSI/SI is used as the reproduction start position information. The event ID is sent out from either the 
output controlling unit 210 based upon fire of an event message or sent out from the demultiplexer 203. When the 
program switching monitoring unit 301 judges that the first state is transferred to the second state, it controls the 
selector 302 to select the terminal b and controls a selector 1501 to select a terminal d, respectively, and informs 
read-out searching unit 1501 of the event ID which was stored in the original program memory 303. 

[01 14] The read-out searching unit 1502 reads out a video/audio stream (packet) after the event ID from the storii 
device 208 in accordance with the event ID which was informed, and sends out It to the read-out reproduction 
position obtaining unit 305. Thus, it becomes possible to read out from the video/audio stream at the position whi* 
was designated by the event ID and to reproduce it. 

[01 15] The catch-up reproduction processing unit 307 executes catch-up reproduction processing concerning the 
video/audio stream which was read out, in the same way as in the above embodiment. Then, the time difference 
detecting unit 306, at the time point that the time difference was solved, controls the selector 302 and the selectoi 
1601. 

[01 16] In addition, an event relation table ERT (Event Relation Table) etc. may be used as the reproduction start 
position information. Further, sequence number of a packet may be used as the reproduction start position, 
information. Further, time management information* at the time point of program switching may be obtained and 
reproduction of a stream may be executed from the position which is shown by the time management information 

[01 17] Furthermore, the reproduction start position information is not limited to the time point that a program was 
switched. For example, it may be a head position of a certain program content (for example, commercial program 
which is included in a main program. 

[01 18] Next, an operation example of the receiving terminal device configured as described above according to th 
embodiment will be explained by use of Fig. 16. Fig. 16 is a view for explaining a condition of program switching 
when a program is viewed as a stream. 

[0119] Firstly, it is assumed that a viewer is selecting a real time program A of a broadcasting station which is 
conducting a program providing service in which storage/catch-up reproduction is possible. In addition, it is assun 
that a data broadcasting program B is one which realizes a interlock type data broadcasting service of the progra 
and transferred in advance by the Carousel system and stored in the storing device 208. 

« 

[0120] Now, it is assumed that while a main program content is being viewed, program switching El occurs and s 
screen is switched to the data broadcasting program B (FIG. 16B). The program switching El occurs by fire of an 
event message which is transferred in a data broadcasting channel or a program switching operation by a viewer 
After lapse of a predetermined time, if the program switching E2 occurred or the program A was selected again, t 
receiving terminal device starts reproduction of the program A which is stored in accordance with the reproductior 
start position information. It is assumed that, the reproduction start position information M2 is designated in advar 
by an instruction from the broadcasting station. At this time, the receiving terminal device executes the catch-up 
reproduction processing concerning CM2, in order to solve the time difference which was generated by the 
interruption. The receiving terminal device, while the catch-up reproduction processing is being executed, display 
the time difference information on the screen, in order to present to the viewer how much time difference has 
occurred. The catch-up reproduction processing is executed, for example, on CM2 and the main program conteni 
When the receiving terminal device judges that the time difference was resolved (caught up) by the catch-up 
reproduction processing, it reproduces the main program content of the program A under the normal reproductior 

[0121] In addition, in the embodiment, a position which is shown by the reproduction start position information is f 
but Ml before the program switching time point may be designated. In this case, CM1 is made to be reproduced 
from the beginning. This means that a viewer can view the whole CM1 . 



[Other Embodiment] 
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[0122] The above-described respective embodiments are examples for explaining the invention, and it does'not 
mean that the invention is limited only to these embodiments. 

[0123] The invention can be practiced in various embodiments as exemplified below as long as not deviated from 
spirit of the invention. 

(1) In the above-described embodiments, as causes of program switching, it is explained about one by a viewer 
himself/herself and/or one by an event message, but it may be one by effect of reservation using EPG and one b) 

li\ link descriptoi- arid a hyper link descriptor. Further, switching may be executed by executing launchDocumentQ ai 
an applet of scripts Jn contents data. These program switching is detected by a script which parses an instruction 
from the input unit or detected by a script for changing a service ID and/or RID. 

(2) The receiving terminal device may be configured to store as an entire transport stream during the stream is 
stored. Further, as to a stream to which a scramble is applied to, it is preferable to store it after it was descramble 

(3) The receiving terminal device may be configured to be able to select whether contents such as a flash report 
according absolute time is displayed or not, on the occasion of the catch-up reproduction processing, by an 
instruction of a viewer. 

(4) In the above-described embodiments, it is explained about the switching between a real time type program an 
data broadcasting program but it is not stick upon this combination in particular. An embodiment for switchirig 
between real time type programs, between data broadcasting programs is included in the aspect of the invention. 
Further, the first stream may be a real time type program and the second stream may be a program which was vi> 
recorded. 

In case of the switching between the above-described real time programs, a plurality of receiving functions are 
required. On the other hand, in case of the switching between data broadcasting programs, a function to store 
multiple Carousel data in plurality is required. These required functions can be implemented in response to the 
above switching need. For example, If there is a request for switching real time programs A, B, and C, one by one 
least three receiving functions are required. On the other hand, if an operation is set to execute transition only in 1^.. 
same TS at a broadcasting station side, only one receiving function may be required. Further, if the program after 
the switch must be returned to the original program by all means even in case of switching by an operation of the 
viewer, only two receiving functions may be required. 

(5) In the above-described embodiments, it is assumed that, when a viewer switched the program A to the progra 
B, video recording is executed to the program A uniformly but, the video recording may be executed under select 
of the viewer. That is, the viewer operates a first operation to switch from the program A to the program B, video 
recording to the program A maybe executed, and when the viewer operates a second operation, video recording 
the program, A may not be executed. The first and second operations are judged by, for example, sort of a button 
Which is preissed down. 

(6) When the program selection is not returned back to the program A for a predetermined time after the selectior 
switched from the program A to the program B and the receiving terminal device has started the video recording ( 
the program A, the receiving terminal device may stop the video recording of the program A. 

(7) The video recording that starts when the program selection is switched from the program A to the program B r 
. be designed such that it records only the program A. That is, the receiving terminal device stops the video record 

at the time when the program A ends; it does not record another program which is broadcasted following the 
program A. Whether broadcasting of a program ends or not is judged with reference to EIT (Event Information 
Table). 

[0124] As stated above, according to the invention, it becomes possible to provide a broadcasting service which 
does not cause a viewing failure of a program content, even in case that a switching of program selection is 
executed. 
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RECEIVING TERMINAL DEVICE AND CONTROL METHOD THEREFOR 



Claims of EP1 255404 • 



^\ 1 . A receiving terminal device characterized in that, when a first program which is being provided is switched to a 
second program, said receiving terminal device provides the second program and starts a video recording of the • 
program, and, when the switched second program is switched back to the first program, provides the recorded fin 
program. 

2. The receiving terminal device according to Claim 1 , 

characterized in that, when the first program is selected again, said receiving terminal device executes a catch-uf 
reproduction of the first program in the manner such that the position 'of reproducing the first program catches up 
with the position in which the first program is being broadcasted by a broadcasting station. 

3. The receiving terminal device according to Claim 2, 

characterized in that said receiving terminal device stops the video recording of the first program when the positic 
of reproducing the first program catches up with the position in which the first program is being broadcasted by th 
broadcaisting station. 

4. The receiving terminal device according to Claim 2 or Claim 3, characterized in that said receiving terminal 6e\ 
thins out a commercial* program in the first program. 

5. The receiving terminal device according to Claim 2 or Claim 3, characterized in that, when two or more 
commercial programs of a predetermined content are included in the i-ecorded first program, said receiving termir*' 
device provides the commercial program once. 

6. A receiving terminal device which selects a particular stream from a received steam and reproduces the select- 
stream as video/audio information, characterized in that, when a second stream is selected while a first stream is 
being filtered through, said receiving terminal device stores a portion of the first stream following the time point at 
which the second stream is selected, and reproduces the second stream. 

7. The receiving terminal device according to Claim 6, 

characterized in that, when the first stream is selected again after the second stream is selected, said receiving 
terminal device reproduces the stored stream. 

8. The receiving terminal device according to Claim 7, 

characterized in that said receiving terminal device obtains a reproduction start position information from the 
received stream and reproduces the stored stream from the reproduction start position. 

9. The receiving terminal device according to Claim 7, 

characterized,;in that said receiving terminal device obtains time management information in the selected time poi 
and reproduces the stored stream from the position specified in the obtained time management information. 

10. The receiving terminal device according to Claims 7 to 9, characterized in that, when the first stream is select 
again, said receiving terminal device reproduces the stored stream in the manner that a reproduction position of t 
stored stream in a reproduction time axis catches up with a reproduction position of the first stream in a real time 
axis. 

1 1 . The receiving terminal device according to Claim 1 0. 

characterized in that said receiving terminal device displays on a screen a time difference information between th 
reproduction position of the stored stream in the reproduction time axis and the reproduction position of the first 
stream in the real time axis. 

12. The receiving terminal device according to Claim 10, 

characterized in that said receiving terminal device reproduces the stored stream while a thin-out processing to \Y 
stored stream. 
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1 3. The receiving terminal device according to Claim 12,' 

characterized in that said receiving terminal device executes a thin-out prpcessing on a partial stream corresponc 
to a predetermined program content in the stored stream. 

14. The receiving terminal device according to Claim 12, 

characterized in that said receiving terminal device executes a thin-out processing of a partial stream correspond 
to a program content other than a program content in the stored stream which is selected in accordance with use 
information inputted in advance. 

15. The receiving terminal device according to Claim 12, 

characterized in that, when the stored stream includes n partial streams corresponding to a predetermined progra 
content, said receiving temninal device thins out n-1 partial streams. 

16. The receiving terminal device according to Claim 13, 

characterized in that said receiving terminal device stores the thinned out partial streams. 

17. The receiving terminal device according to Claim 10, 

characterized in that said receiving terminal device stores the first stream until the reproduction position of the stc 
stream in the reproduction time axis catches up with the reproduction position of the first stream in the real time a 



18. The receiving terminal device according to Claim 6, 

characterized in that, when the first stream is selected again after said second stream is selected, said receivirig 
terminal device reproduces the selected first stream on a first window and reproduces the stored stream on a 
si9Cond window, 

19. The receiving terminal device according to Claim 18, 

characterized in that said receiving terminal device reproduces the partial stream corresponding to the first progr£ 
content in the stored stream on the second window. 

20. The receiving terminal device according to Claim 10, 

characterized in that said receiving terminal device executes fast play reproduction of the partial stream 
corresponding to the second program content in the stored stream on the first window. 

21 . The receiving terminal device according to Claim 6, 

characterized in that said receiving terminal device selects the second stream based upon program selection 
information in the received stream. 

22. The receiving terminal device according to Claim 6, 

characterized in that said receiving terminal device selects the second stream based upon program selection 
information supplied from a viewer. 

23. The receiving terminal dievice according to Claim 6, 

characterized in that said receiving terminal device selects the second stream based upon schedule Information s 
based upon program guide information. 

24. A receiving terminal device comprising: 

a stream receiver for receiving a transferred stream, 
a storing unit for storing the received stream, 

an accepting device for receiving program selection information for selecting a program to be provided to a viewe 
a selector for selecting a particular stream in the received stream based upon the program selection information, 
an output unit for outputting video/audio information based upon a stream to be transmitted, and 
when the program selection information for selecting a second stream is received while a first stream is being filte 
through, a controller for outputting a stream in the first stream following the time point at which the second streanr 
selected to the storing unit. 



25. The receiving terminal device according to Claim 24, 
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wherein the controller, when the program selection information for selecting the first stream is received after the 
second stream is selected, reads out a stream stored in the storing unit and transmits the read out stream to the 
output unit. . 

26. The receiving terminal device according to Claim 25, 

wherein the controller includes a reproduction start position management unit for managing a reproduction start 
position of the stream transmitted to the output unit. 

k\ 27. The receiving terminal device according to Claim 26, 
wherein the reproduction start position management unit outputs the stream to the output unit from a position 
specified in the reproduction start position information allocated to the stream to be outputted to the storing devici 

28. The receiving terminal device according to Claim 26, 

wherein the reproduction start position management unit includes a switching time management unit for obtaininc 
time management information at the time of receiving program switching information by the accepting unit, and 
wherein the reproduction start position management unit outputs the stream to the output unit from a position 
specified in the obtained time management information. 

29. The. receiving terminal device according to Claim 25, 

wherein the reproduction start position management unit reproduces a stream outputted from the storing unit to tf 
output unit in the manner that the reproduction position of the stream outputted from the storing unit to the output 
unit catches up with the reproduction position of the first stream to be outputted from the receiver to the output un 

30. The receiving terminal device according to Claim 25, 

wherein the controller outputs the stored stream to the storing device until the reproduction position of the stream 
which is outputted from the storing unit to the output unit catches up with the reproduction position of the first stre 
to be outputted from the receiver to the output unit. 

31. The receiving terminal device according to Claim 25, 

wherein the controller, when the first stream is selected again after the second stream is selectisd, transmits the fi 
stream which is transmitted from the receiver and the stream which is read out from the storing unit to the output 
unit, respectively. 

32. The receiving terminal device according to Claim 24, 

wherein the .accepting unit detects program switching information included in the received stream. 

33. A program providing method comprising steps of: 

switching a first program to a second program while the first program is being provided, 
video recording of the first program while the switched second program is being provided, 
. switching back to the first program while the switched second program is being provided, and 
providing the first program which is being recorded. 



34. The program providing method according to Claim 33, 

wherein when the first program is switched back, the recorded first program is executed in the manner such that 1 
a position of recording and reproducing the first program catches up with the position in which the first program is 
being broadcasted by a broadcasting station. 

35. The program providing method according to Claim 34, 

wherein the first program is recorded until the position of recording and reproducing the first program catches up ' 
the position in which the first program is being broadcasted by the broadcasting station by the catch-up reproduct 



36. A control method of a receiving terminal device in which a particular stream in a received stream is selected, i 
the selected stream is reproduced as video/audio information, 

wherein when a second program is selected while a first stream is being filtered through, a stream in the first stre. 
following a time point at which the second stream is selected is stored and the selected second stream is 
reproduced. 
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37. The control method of the receiving terminal device according to Claim 36. wherein the stored stream is ' 
reproduced when the first stream is selected again after the second stream is selected. 
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